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Abstract. Nilsequences arose in the study of the multiple ergodic averages as- 
sociated to Furstenberg's proof of Szemeredi's Theorem and have since played 
a role in problems in additive combinatorics. Nilsequences are a generaliza- 
tion of almost periodic sequences and we study which portions of the classical 
theory for almost periodic sequences can be generalized for two step nilse- 
quences. We state and prove basic properties for 2-step nilsequences and give 
a classification scheme for them. 



Traditional Fourier analysis has been used with great success to study problems 
that are linear in nature. For example, Roth used Fourier techniques (the circle 
method) to show that a set of integers with positive upper density contains infinitely 
many arithmetic progressions of length 3 and van der Corput used such methods 
to show that the primes contain infinitely many arithmetic progressions of length 
3. These questions can be reformulated into solving a certain linear equation in a 
subset of the integers, making them tractable to Fourier analysis; the linear nature 
of the equation is a key ingredient in the use of Fourier techniques. 

Finer analysis is needed to study longer arithmetic progressions or more compli- 
cated patterns. This analysis is necessarily quadratic (or of higher order) in nature. 
The basic objects in such an analysis are the nilsequences (the precise definition 
is given in[T]). Nilsequences were introduced in 2J for studying some problems in 
ergodic theory and additive combinatorics that arose from the multiple ergodic av- 
erages introduced by Furstenberg ^5] in his ergodic theoretic proof of Szemeredi's 
Theorem. Two-step nilsequences play a role in the recent work of Green and Tao 
(see [6] and [7]) on arithmetic progressions of length 4 in the primes; higher or- 
der nilsequences are conjectured to play an analogous role for longer arithmetic 
progressions. 

In spite of the recent uses of nilsequences in a variety of contexts, as of yet there 
is no systematic study of them. Even some of the basic properties are neither stated 
nor proved. In this paper, we carry out such an analysis for 2-step nilsequences 
and hope that this clarifies their role and properties. In a forthcoming paper [5], 
we give applications of the results in this paper. 

Almost periodic sequences and their classically understood properties are a 
model we would like to emulate for nilsequences. Almost periodic sequences (which 
are exactly 1-step nilsequences) arise naturally in understanding the correlation 
sequence 
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where {X, X, fi, T) is a measure preserving probability system and / G L°°{ii). In a 
similar way, 2-step nilsequences arise in [2] for understanding the double correlation 
sequence 



Unfortunately, there are fundamental differences between the 1-step (almost peri- 
odic) and 2-step nilsequences that make it impossible to carry over the classical 
results in a straightforward manner. Namely, we no longer have functions such as 
the trigonometric functions that form a basis. 

On the other hand, there is a class of nilsequences called elementary nilsequences 
(see Definition [3|) that are the building blocks for all nilsequences. Using these, 
we obtain a density result (Theorem [5]) analogous to the density of trigonometric 
polynomials in . Restricting to the elementary nilsequences, we can classify them 
such that each elementary nilsequence belongs to a class with a particularly simple 
representative of this class. 

Throughout this article, we restrict ourselves to 2-step nilsequences. Some of 
the analysis here can be carried out for higher levels, but most of the results are 
relative to the previous level of almost periodic sequences. The detailed analysis of 
higher order nilsequences begins with a firm understanding of the 2-step ones. 



2.1. Almost periodic sequences. 

Notation. In general, we denote a sequence by a = (a„: n G Z). Given a, we use 
(jsl to denote the shifted sequence. Thus for fc G Z, by cr'^'a, we mean the shifted 



For t := M/Z, we use the standard notation e{t) = exp(27rii). The exponen- 
tial linear sequence e{t) is defined by e{t) — {e{nt) : n G Z). 

Proposition 1 (and definition). For a bounded sequence a = (a„ : n G Z), the 

following properties are equivalent: 

(i) There exist a compact abelian group G, an element t of G, and a contin- 
uous function f on G such that a„ = f{T^^) for every n £ 1j. 

(ii) The sequence a is a uniform limit of linear combinations of exponential 
sequences. 

(iii) The family of translated sequences {cr'^a: fc G Z} is relatively compact un- 
der the £°°-norm. 

A sequence satisfying these properties is called almost periodic. 

The family of almost periodic sequences forms a sub-algebra of £°° , closed under 
complex conjugation, the shift and under uniform limits. We denote this sub- 
algebra by AV. 

2.2. 2-step nilsequences. 

Definition 1. When G is a group, G2 denotes its commutator subgroup, that is 
the subgroup spanned by elements of the form ghg~^h~^ for g,h G G. G is 2-step 
nilpotent if G2 is included in the center of G. 

If G is a 2-step nilpotent Lie group and F C G is a discrete and cocompact 
subgroup, then the compact manifold X = G/T is called a 2-step nilmanifold. The 
action of G on X by left translation is written {g,x) ^ g ■ x for g £ G and x £ X. 




2. Definitions and examples 



sequence a'^a = (a„+fc : n G Z). 
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A 2-step nilmanifold X — G/T, endowed with the translation T: x |—^ t ■ x hy some 
fixed element r of G is called a 2-step nilsystem. 

If / : X — » C is a continuous function, t ^ G and xq e X, then (/(r" -xo) : n e Z) 
is a basic 2-step nilsequence. A 2-step nilsequence is a uniform limit of basic 2-step 
nilsequences. 

With small modifications, this generalizes condition Q in Proposition [TJ There 
is a technical difficulty that explains the need to take uniform limits of basic nilse- 
quences, rather than just nilsequences. Namely, AV is closed under the uniform 
norm, while the family of basic 2-step nilsequences is not. An inverse limit of rota- 
tions on compact abelian Lie groups is also a rotation on a compact abelian group, 
but the same result does not hold for nilsystems: the inverse limit of a sequence 
of 2-step nilmanifolds is not, in general, the homogeneous space of some locally 
compact abelian group (see '16]). The other conditions in Proposition [T] do not 
have straightforward modifications that generalize for 2-step nilsequences. After 
introducing some particular classes of 2-step nilsequences, we develop analogs of 
these other conditions. 

There is an alternate characterization of 2-step nilsequences: 

Proposition (see [9]). A sequence a = (a„ : n G Z) is a 2-step nilsequence if there 
exist an inverse limit {X,T) of 2-step nilsystems, a continuous function f on X, 
and a point xq E X such that a„ = /(T"a;o) for every n E Z,. 

Definition [U with the obvious changes, defines a fc-step nilsequence. However, 
in this article we restrict ourselves to studying 2-step nilsequences. 

Convention. We often omit the 2-step from our terminology and just refer to a 2- 
step nilsequence as a nilsequence. Similarly, a nilsystem refers to a 2-step nilsystem. 

We introduce some particular 2-step nilsequences that play a particular role in 
the sequel. 

2.3. Afflne systems and quadratic sequences. 

Notation. For t eT, let q(t) = {qn{t) : n e Z) denote the sequence given by 

Qn{t) = e( ^ ^ U ) for n e Z . 
This sequence is called a quadratic exponential sequence. 

We show that any sequence q(i) is a nilsequence. We first remark that this 
sequence is almost periodic if and only if t is rational and that in this case it is 
periodic. 

Let G = Z X T X T, r = Z X {0} X {0} with muhiphcation defined by 

(m, x, y) ■ {m' , x' , y') — {m + m', x + a;', j/ + y' + mx') . 

Then G is a 2-step nilpotent Lie group, with G2 = {0} x {0} x T, and F is a discrete 
cocompact subgroup. Set X = G/F. Fix some a,/? G T, and set r = (l,a,/?) E G 
and endow X with the translation T by r. 

We can give another description of this system. The map (m, a;, y) 1— > (cc, y) 
from G — > induces a homeomorphism from X to T^. Identifying these spaces, 
T becomes the familiar skew transformation (x, ?/) i-^ (x + a, y + a; + /3) of T^. 
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We describe some nilsequences arising from this system. Set xo — (0,0) G X. 
Let / be the continuous function on X given by f{x,y) = e{y). For every n G Z, 

/(T"xo) = e(^fc^a + n/3) = g„(a)e„(/3) . 

Thus every product of a quadratic exponential sequence and an exponential se- 
quence is a basic elementary nilsequence (In particular, an exponential sequence is 
a basic nilsequence). 

2.4. Heisenberg nilsystems. 

2.4.1. Heisenberg groups. Let d > 1 be an integer. The Heisenberg group of di- 
mension 2d+ 1 is G = M^'^+i, identified with R'' x R'' x M and endowed with 
multiplication given by 

{x, y, z) ■ {x', y', z') = {x+x', y+y', z+z'+ {x | y') where x, y, x',y' eM!^, z,z' €R 

and (• I •) is the usual inner product on M.'^. The commutator subgroup G2 of G is 
{0}'* X {0}'^ X R and G is a 2-step nilpotent Lie group. We set T = 1?'^+'^ . Then 
r is a discrete cocompact subgroup of G. The nilmanifold Nd = G/T is called the 
Heisenberg nilmanifold of dimension 2d + I. 

We give another representation of this nilmanifold, which is more useful in the 
sequel. The subgroup K = {0}'^ x {0}'^ x Z is normal in G, and is included in F. 
We thus have that = Hd/Ku where A^,; = G/K, Ad = T/K. That is, 

Hd = W^ y^M.'^ X S\ Ad = Z'' X Z'' X {1} , 

where the multiplication is given by 

(1) 

{x, y, z) ■ {x', y', z') = {x + x',y + y', zz'e{{x \ y'))) {x, y, x', y' G R^ z,z' €S^) . 

(Note that denotes the circle while T = R/Z is called the torus.) When 
Nd is endowed with the translation by some element r of Hd, {Nd,T) is called a 
Heisenberg nilsystem. The commutator subgroup of Hd is {0}'' x {0}'^ x S . 

2.4.2. Nilsequences arising from Heisenberg nilsystems. 
Notation. For s, < e T, we set 

(2) k{s, t) := ^ exp(-7r(t + kf)e{ks) . 

We write u}{a,(3) = (a;„(a, (3): n G Z) for the sequence defined by 

TiiTl — 1 ) 

bJn{a,l3) = K{na,n(3)e{ ^ a/J) for n G Z . 

We show that products of sequences of this type are are 2-step nilsequences. 
Remark. The function k is linked to the classical theta function 
6{u, z) = ^ exp(7ri^;n^ + 2mnu) 

by 

(3) k(s, t) = cxp{-nt'^)e{s + it, i) . 

This is a particular case of well known relations between Heisenberg groups and 
theta functions. 
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We start by explaining how to build explicit continuous functions on Nd. It is 
not as easy to do this as it is for afRnc systems, because the nilmanifold Hd is not 
homeomorphic to a torus. 

Let be a continuous function on M'', tending to zero sufficiently fast at infinity. 
Define a function / on Hd by 

fix, y,z)^zJ2 <^(y + k)e{{k \ x)) {x, y £ z G S^) . 

We note that for all k,£ E Z'*, we have f[{x,y,z) ■ (fc,^, 1)) = f{x,y,z). In other 
words, the function / on G is invariant under right translations by elements of A^, 
and thus it induces a continuous function / on Nd- 

The most interesting case is when is the Gaussian function (f>{x) — exp(— 7r||x|p), 
where ||-|| is the usual euclidean norm in R"*. 

In this case we have: 

d 

(4) f{x,y,z) = zY[K{xj,yj) . 

i=i 

Set T — {a, f3, e{j)) e Hd, where a = (ai, . . . , ad) and (3 — {Pi, ... , /3d) belong 
to R** and 7 e T and define T to be the translation by r on Nd- For every n El, 
we have 

r" = [na,nf3,e{n^)e C^'^~^\ a \ /?))) . 

Let xq be the image in Nd of the element (0, 0, 1) of Hd and / the function on Nd 
associated to the function / defined by (jl]). Then for every n G Z, we have 

(5) /(T":ro) = e(n7)e(^^^^^(a | J] ^(na„n/3,) 

= e„(7)cj„(ai,/3i). • • • .w„(ad,/3d) • 

2.5. Some counterexamples. There are other natural quadratic-type sequences 
that are particularly simple to construct, and so it is natural to ask if these are 
(elementary) nilsequences. For example, consider the sequence (e([naJn/3): n E 
TL). This is not a nilsequence, as it can not be obtained as a uniform limit of 
sequences associated to continuous functions on nilmanifolds. On the other hand, 
this sequence is a "Besicovitch" elementary nilsequence, meaning that it is a limit 
of elementary nilsequences in quadratic averages. This can be seen by considering 
the simpler sequence (e([naJ/3): n G Z). Although at first glance it looks like 
an almost periodic sequence, it is not: under the uniform norm, the sequence 
(e([na + 7J/3): n E Z) does not depend continuously on 7. The family of shifted 
sequences (a„-|_fe : n G Z) is not relatively compact under the uniform norm, but only 
in quadratic average. A similar problem occurs with the sequence (e([na]n/3) : n G 
Z) . A more complete explanation is given in Appendix [C] 

Objects similar to our nilsequences arise in several other contexts. For example. 
Green and Tao [B] use nilsequences to give asymptotics for the number of progres- 
sions of length 4 in the primes. Their definition is slightly different: the underlying 
group G is assumed to be connected and simply connected. Moreover, in all their 
uses of nilsequences the function defining it is taken to be Riemann integrable. 
This weaker hypothesis on the function (we assume continuity) accounts for the 
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difference in sequences that arise. In particular, sequences with integer parts can 
be obtained from Riemann integrable functions, but not from continuous functions. 
Perhaps more important is the difference in point of view. In Green and Tao, they 
consider finite (albeit long) sequences taken from a nilsequence. The importance 
is that this point of view is local and in this context, quadratic sequences are the 
natural local model for 2-step nilsequences. In giving a global model for 2-step 
nilsequences, this program no longer can be carried through. 

In [3], Bergelson and Leibman show that all generalized polynomials arise by 
evaluating a piecewise polynomial mapping on a nilmanifold. However, in order 
to obtain all generalized polynomials, they necessarily must allow functions with 
discontinuities. Our nilsequences are recurrent, while some generalized polynomials 
take on non-recurring values. 

3. Results 

3.1. First properties. 

Notation. We denote the family by of (2-step) nilsequences by A/"^. 

Some classical properties of 2-step nilsystems are recalled in Section [H 
Proposition 2. 

• The family of nilsequences is a sub-algebra of that contains AV and 
is invariant under complex conjugation, shift and uniform limits. 

• If EL is a nilsequence and (Ij)j^fi is a sequence of intervals of Z whose 
lengths tend to infinity, then the limit 




exists and does not depend on choice of the sequence (Ij ) of intervals. 

If a and b are nilsequences, then the product sequence ab := (a„bn: n e Z} 
is a nilsequence. This, together with the second part of Proposition [2] justifies the 
following definition: 

Definition 2. The inner product of two nilsequences a and b is defined to be 

I ^-^ _ 
(a I b) := Av(ab) = lim — V a„6„ . 

A'^ + oo iV ^ — ^ 

n=0 

The quadratic norm of the nilsequence a is 

1 1/2 

||a||.:=(Av(|an)^/^.^hm^l(^KP) . 

n— 

In Section we check that ||-||2 is a norm on the space 7V^ of nilsequences. 

3.2. Elementary 2-step nilsequences. There is no direct generalization of the 
second property of Proposition[l]for 2-step nilsequences, as there is no strict analog 
of exponential sequences. However, some particular nilsequences play a similar role, 
and these are the building blocks for all nilsequences. 
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Definition 3. A 2-stcp nilmanifold X is an elementary (2- step) nilmanifold if it 
can be written as X ^ G/T as in Definition [H where G2 is the circle group S^. An 
elementary nilsystem is a nilsystcni {X = G/T,T) such that X is an elementary 
nilmanifold. 

When X = G/r is an elementary nilmanifold (written such that G2 = S^), we 
write Ci{X) for the family of continuous functions / on X such that 

(6) f{u ■ x) = uf{x) for aU u e G2 = and all x e X . 

If {X,T) is an elementary nilsystem, / G Ci{X) and xq € X, the sequence 
(/(2^"2^o) : G is a 6asic elementary nilsequence. A uniform limit of basic 
elementary nilsequences is an elementary nilsequence. 

By convention, every almost periodic sequence is also considered to be an ele- 
mentary nilsequence. 

There are several things left imprecise in the definition of an elementary nilman- 
ifold. First, the same nilmanifold X can be written as G/T in different ways, and 
the term "elementary nilmanifold" refers in fact to a given presentation of X and 
not only to the nilmanifold. Moreover, when we say that "G2 = S^" we do not 
mean only that these groups are isomorphic, but also that we make the choice of a 
particular isomorphism that defines the identification. 

Definition 4. Let {X — G/T, T) be an elementary nilsystem. The same system 
but with the opposite identification of G2 with S is called the conjugate system of 
X and is written {X,T). We note that for / e Ci{X), we have that / G Ci{X). 

Under the usual identification of T with S^, the afhne system {X^T) introduced 
in Section [2?3l is an elementary nilsystem, the function / belongs to Ci{X) and the 
sequence ((3'„(a)en(/3) : n G Z) is a basic elementary nilsequence. 

The Heisenberg system (A^^, T) introduced in Section 12.4.11 is an elementary 
nilsystem, and the sequence defined in ([5]) is a basic elementary nilsequence. 

Proposition 3. The family of elementary nilsequences is closed under complex 
conjugation, the shift, taking products and uniform limits. 

All these properties follow immediately from the definitions, other than the clo- 
sure under products. This is proved in Section [6] (Proposition [6|) . 

The next Proposition (proved in Section 14. 5p is a nilsequence version of the 
characterization of almost periodic sequences given by Part ([u| of Proposition [TJ 

Proposition 4. Every nilsequence is a uniform limit of finite sums of elementary 
nilsequences. 

In this statement, we can obviously substitute "basic elementary nilsequences" 
for elementary nilsequences. 

The family of 2-step nilsequences has no characterization similar to property jml 
of Proposition [TJ However, the smaller class of elementary nilsequences does (see 
Section [9] for the proof): 

Theorem 1. Let a = (a„: n G Z) &e a bounded sequence. The following are 
equivalent: 

(i) a is an elementary nilsequence. 

ill) There exists a compact (in the norm topology) subset K C such 
that for all fc G Z, there exists t G T such that the sequence e(i)a'^a = 
{e{nt)an+k ■ n E 7)j belongs to K . 
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3.3. The class of an elementary nilsequence. Theorem [T] makes it clear that 
the fundamental objects are not elementary nilsequences, but rather elementary 
nilsequences considered relative to almost periodic sequences. This motivates the 
next definition. 

Definition 5. Let a — (a„: n e Z) be a bounded sequence. The class S{a) of 
a is the norm closure in of the vector space spanned by sequences of the form 
e{t)a''a — (e(nt)a„+fe : n G Z) for i £ T and fc g Z. 

The class of an elementary nilsequence contains only elementary nilsequences. If 
a is a non-idcntically zero almost periodic sequence, then iS(a) = AP. 

Remark. The reason for the introduction of the shift in the definition of the class 
5 (a) is not obvious at this point but is clarified later (proof of Corollary [3]) . In 
fact, if an elementary sequence a is such that the sequence (|an| : n G Z) is bounded 
from below, then the shift can be removed from the definition: iS(a) is spanned by 
sequences of the form e(i)a. However, there are very few elementary nilsequences 
of this type: they all are products of an almost periodic sequence and a quadratic 
sequence q{t) , as defined in Section 12.31 The situation is different if we use the 
quadratic norm (see the proof of Theorem [5] in Section . 

In Section [6.31 we show: 

Theorem 2. 

(i) The classes of two elementary nilsequences are either identical or are or- 



thogonal. This means that if a and b are non- identically zero elementary 
nilsequences, then: 



(ii) The classes form a partition of the set of elementary nilsequences into open 
subsets. 

(iii) // a and b are elementary nilsequences, then there exists an elementary 
nilsequence c such that 5(a) • S{h) :— {a'b' : a' G 5(a), b' G 5(b)} is 
included in 5(c). 

(iv) Endowed with this multiplication, the family of classes is an abelian group. 

3.4. Classification. In light of the last two parts of Theorem[2l it would be nice to 
classify elementary nilsequences. Optimally, one would like to classify the elemen- 
tary nilsequences by giving an explicit representative in every class. Unfortunately, 
this is not possible as there is no reasonable (i.e. Borel) way to choose this repre- 
sentative. However, we can partially succeed in giving a classification, by reducing 
to some particular nilsequences. 

Our classification of elementary nilsequences is related to, but not identical to, 
a classification of elementary nilsystems. In this classification, non-isomorphic nil- 
systems may give rise to the same class of nilsequences. 

Notation. Let d > 1 be an integer. We write J2d for the 2d x 2d matrix 



• //b G 5(a), then 5(b) = 5(a). 

• //b ^ 5(a), then Av(ab) ~ 0, that is 




N-l 
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where the represents the d x d zero matrix and Id^ the d x d identity matrix. 

Let Sp2d(Q) denote the group of 2d x 2d matrices M with rational entries which 
preserve the antisymmetric bilinear form associated to J2d, that is, with 



M'j2dM = J: 



2d 



In an equivalent way, M can be written in d x d blocks as 



M = 



C D 



where A*C and D^^B are symmetric and D^A — B^C = Id^- 

Convention. In the next theorem and in the sequel, the empty product is by 
convention set to be 1. 

Theorem 3. Let t G T fee either equal to or irrational, let d > be an integer 
and let ai, . . . ,Q;rf,/3i, . .. ,13d he reals, rationally independent modulo 1. Then the 
sequence (\[t) ijj{ai, [3i). ■ ■ ■ .ijj{ad,Pd) is an elementary nilsequence. 

Every elementary nilsequence belongs to the class of a sequence of this type. 

Let t, t' G T , d, d' > and ai, . . . , ad, Pi, . . . , Pd and a[, . . . , a'j^,, I3[, . . . , /3^, be 
rationally independent modulo 1. Then the sequences q(i) a;(Q!i, • • • .ijj{ad,Pd) 
and q{t') u:{a'i, P'l). ■ ■ ■ .u}{a'^, , (3'^,) belong to the same class if and only if d = d' 
and there exist a 2d x 2d matrix Q € Sp2(i( 
with m > 1 such that 



and integers m, ki 



f ai + ki/m\ 

ad + kd/m 
\Pd + (^dlmJ 



Vd) 



and m{t — t') = ^^(fci/?i — £iai) mod 1 



If d = in the first part of the theorem, then the sequence is q(i) and the 
hypothesis of independence is vacuous. If d d' = in the second part of the 
theorem, then the sequences are q(t) and q(i') and the condition means simply 
that t — t' is rational. 

3.5. Density results. Together, the examples of nilsequences introduced in Sec- 
tions [2?3l ad [2A2l span the 2-step nilsequences and so we give them a name: 

Notation. We write for the family of sequences of the form 

e{s)q{t)uj{ai,Pi). - ■ ■ .u}{ad,(3d) 

where s, i € T, d > is an integer and ai, . . . , ad, Pi, . . . , Pd are reals that are 
rationally independent modulo 1. 

Theorem 4. The space of 2-step nilsequences is the closed shift invariant linear 
space spanned by the family A4 of sequences. 

For the quadratic norm, we have a density result analog of Theorem IH without 
needing to include shifts of the sequences: 

Theorem 5. The linear span of the family M of sequences in dense in the space 
AA^ of 2-step nilsequences under the quadratic norm. 

However, Theorem |3] shows that Ai is not a basis for A/"^. 
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3.6. Higher order nilsequences. Some of the analysis in this paper for 2-step 
nilsequences can be carried out for higher levels. We can define elementary fc-step 
nilsequences by simply replacing G2 by Gfe. Then arbitrary fc-step nilsequences 
can be approximated by elementary ones. However, the problem then becomes 
finding the analog of the span of (elementary) fc-step nilsequences and giving a 
characterization of (elementary) fc-step nilsequences. 

One of the advantages of working with 2-step nilsequences is that we have the 
family of theta functions and associated theta sequences that simplify the classifi- 
cation. Representations of fc-step nilpotent groups for fc > 3 are significantly more 
complicated, and so the related classification of fc-step nilsequences is a difficult 
problem. 

4. Basic properties of nilsystems and nilsequences 

4.1. Nilmanifolds and nilsystems. We recall some classical properties of nil- 
manifolds and nilsystems. For nilmanifolds, we refer to the seminal paper by Mal- 
cev [12]. For nilsystems, we refer to [1], [M], [15] and [H]; these papers deal only 
with the case of connected nilpotent Lie groups and their results were extended to 
the non-connected case in jlOj . 

In section [2.31 we saw that every exponential sequence is a nilsequence. There- 
fore, TV^ D AV. The family of 2-step nilsystems is closed under Cartesian products. 
This, together with Definition [1] immediately implies the first statement of Propo- 
sition [2l 

In the rest of this section, {X = G/T,T) is assumed to be a 2-step nilsystem, 
where T is the left translation by r e G and xq is a point of X. 

Let Y be the closed orbit of xq, that is the closure in X of {T^xq : n G Z}. Then 
(Y, T) can be given the structure of a 2-step nilsystem or of a rotation on a compact 
abelian group. More precisely, there exists a closed subgroup H oi G containing r 
such that A r n is cocompact in H and Y can be identified with H/ K. H is 
a Lie group, either abelian or 2-step nilpotent. 

By substituting H for G and A for F in the definitions of basic 2-step nilsequences 
and of elementary nilsequences, we can restrict to the case that the orbit {T'^xq : n G 
Z} of Xq is dense in A. It is classical that this hypothesis implies: 

(i) (A, T) is minimal (that is, every orbit is dense) and uniquely ergodic: the 
unique T-invariant probability measure is the Haar measure 11 of A, which 
is invariant under the action of G on A. 

Henceforth we assume that our nilsystem satisfies this assumption. 

This immediately implies the second statement of Proposition [2] if a basic nilse- 
quence a is defined as in Definition [TJ then 



Av(a) = 




and the existence of the average in the case of a general nilsequence follows by 
density. 

4.2. The quadratic norm. The quadratic norm ||a||2 of a 2-step nilsequence was 
introduced in Section 13.11 (Definition [2]) ; we check here that it is a norm. 

We only need to show that if a is a non-identically zero nilsequence, then ||a||2 7^ 
0. Let a be a non-identically zero basic nilsequence. Write it as (/(T"a;o) : n G Z), 
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where {X,T) is a minimal nilsystem, / e C{X) and xo G X. By minimality, we 
have that ||a||oo = ||/||oo and that 

for every 6 with < S < ||a||oo, the set {n G Z: |a„| > 6} is syndetic. 

This property is stable under uniform limits and thus holds for all nilsequences. 
The announced result follows. □ 
We remark that ||a||2 < ||a||oo for every nilsequence a. 

4.3. Reduced form of a 2-step nilsystem. We can make some further simpli- 
fying assumptions about the nilsystem, as in ^3j. We only sketch the justification 
of these reductions. 

Let Go be the connected component of the identity in G and let Gi be the 
subgroup of G spanned by Gq and r. Since Gi is open and the projection G — > 
G/T — X is an open map, the image of Gi under this projection is an open subset 
of X. This subset is invariant under T and thus is equal to X by minimality. 
Therefore, substituting Gi for G and F n Gi for F, we can reduce to the case that 

(ii) G is spanned by the connected component Go of the identity and t. 

Let Z(G) be the center of G. We can substitute G/(F n Z(G)) for G, and 
F/ (F n Z{G)) for F. Therefore we can reduce to the case that 

(iii) The intersection of F with the center of G is trivial. 

This implies that F does not contain any nontrivial normal subgroup of G and thus 
that G can be viewed as a group of transformations of X. 
These properties imply that 

(iv) F is abelian. 

(v) G2 is a finite dimensional torus. 

Definition 6. Let {X = G/F,T) be a (2-step) nilsystem {X,T), where T is the 
translation by r G G. We say that (X,T) is in reduced form if G,F,r satisfy the 
hypotheses and (pH]) . 

By the preceding reductions, we see that in the definition of 2-step nilsequences 
we can restrict to the case that the nilsystem is minimal and in reduced form. We 
claim that in the definition of an elementary nilsequences we can restrict ourselves 
to minimal elementary nilsystems written in reduced form. 

Indeed, let {X = G/F, T) be an elementary nilsystem, xo G X, / G Ci{X) and 
let a — {f{T"x): n G Z). We can assume without loss that this sequence is not 
almost periodic. 

Let Y be the closed orbit of xq under T. Then {Y, T) is a not a rotation on a 
compact abelian group and thus is a 2-step nilsystem. We write Y — G' /V , where 
G' is a closed subgroup of G and F' = F n G'. As this system is minimal, we 
can make the second reduction and assume that property (|n]) holds. Then Gj is a 
nontrivial closed connected subgroup of G2 —S^, and thus G'2 — G2 and iY,T) is 
an elementary nilsystem. Moreover, the restriction of / to F belongs to Ci{Y). 

Now we make the last reduction, and write Y = G" /T" by taking the quotient 
of G' and F' by Z{G') fl F'. The existence of the non-identically zero function / in 
Ci{Y) implies that G2 n F' is trivial, and thus the natural projection G2 G2 is 
an isomorphism. We thus have that G2 is the circle group and that / belongs to 
Ci[Y = G"/F"). Our claim is proved. 
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Convention. Henceforth, all nilsystems are implicitly assumed to be minimal and 
in reduced form. 

The Kronecker factor of an ergodic system {X, T, /i) is the factor whose cr-algebra 
is generated by all the eigenfunctions of T. We note the following result for later 
use (see for example \TU\). 

Proposition 5. Let X — G/T where G is a 2-step nilpotent Lie group, T is a 
closed cocompact subgroup and let T be translation by some t G G. Let X be 
endowed with its Haar measure fi. Assume that property ([ii| is satisfied. Then the 
following properties are equivalent: 

(1) (X, T) is minimal. 

(2) The subgroup of G spanned by r and T is dense in G. 

(3) The subgroup of G spanned by r and TG2 is dense in G. 

If these properties are satisfied, then the Kronecker factor of the ergodic system 
{X,n,T) is the compact abelian group Z = G/G2T endowed with translation by the 
image of r. 

4.4. The examples of Section 12.31 and 12. 4L revisited. By the preceding crite- 
ria, the affine system defined in Section [2.3l is minimal if and only if a is irrational. 
We remark that this system is written in reduced form. 

The first presentation of the Heisenberg system Nd ^ G/T given in Section [2T4l 
was not reduced. The reduction to the presentation Nd ~ Hd/Ad we carried out 
in that Section is exactly the reduction explained above to the case that hypoth- 
esis (pli| holds. In this presentation, Nd is written in reduced form. By the cri- 
terion of Proposition [5l the nilsystcm {Nd,T) is minimal if and only if the reals 
ad, Pi, . . . , (3d are rationally independent modulo 1. 

4.5. Decomposition into elementary nilsequences. In this Section, we prove 
Proposition [4] and introduce some notation used in the sequel. 

Let {X = G/T, T) he a minimal 2-step nilsystem in reduced form. 

The restriction of the left translation G x X X to G2 defines a continuous 
action of G2 on X, and this action commutes with T. The quotient of X under 
this action is the compact abelian group Z = G/G2T. 

For every character x oi G2, let Cy(^{X) denote the space of continuous functions 
f on X satisfying 



If X is an elementary nilsystem, that is, if G2 — S^, we identify the dual group G2 
with Z and the notation in ([7]) coincides with the notation in ([6]) of Definition [3] 

Note that Co{X) is the space of functions on X which factorize through Z. Every 
space C-)^{X) is invariant under T and under multiplication by functions belonging 
to Cq{X). The spaces C^{X) corresponding to different characters x are orthogonal 
with respect to the inner product of L'^{fj.). 

Let / £ C{X). For every x S G2, we define a function /^^ on X by 



(7) 



f{u- x) ^ x{u) f{x) {ueG2,xeX). 
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where mca denotes the Haar measure of G2 . Clearly, for every x G G2 . the function 
fx belongs to the space CxiX). Moreover, 

/= E /x 
X6G2 

where the series converges in L'^{X), and in uniform norm whenever / is sufficiently 
smooth. By density, every continuous function f on X can be approximated uni- 
formly by finite sums of the form 

k 

fi , where fi G C^i (X) and Xi G G2 for every i . 

i=l 

Therefore, every basic nilsequence a arising from X as in Definition[l]can be approx- 
imated uniformly by finite sums of nilsequences of the form b = {/{T^'xq) : n € Z), 
where / belongs to C^iX) for some % G G'2. 

We are left with describing sequences b of this form. If x is trivial, then this 
sequence is almost periodic. Assume that x is not trivial. Let Y be the quotient 
of X under the action of the subgroup ker(x) of G2, P- X Y he the natural 
projection and S be the transformation induced by T on Y. Then it is immediate 
that (Y, S) is an elementary nilsystem. Moreover, every / G C^iX) can be written 
as f — 4> o p for some continuous function (f>onY belonging to Ci{Y). Therefore, 
the sequence b is equal to ((/)(S'"yo)), where yo — p{xa). This completes the proof 
of Proposition m □ 

5. The Bohr extension of an elementary nilsystem 

5.1. The space of nilsequences associated to an elementary nilsystem. 

Definition 7. Let {X = G/T, T) be an elementary nilsystem (minimal and written 
in reduced form). We write M^{X) for the closed linear subspace of 1°°{'L) spanned 
by sequences of the form (^f{T"xo) : n G Z) where / G Ci{X) and xq G X. 

Lemma 1. Let {X = G/T,T) be an elementary nilsystem. 

(i) Af'^{X) is invariant under the shift and multiplication by almost periodic 
sequences. 

(ii) For every xi G X , M'^{X) is the closed linear subspace of 1°°{'L) spanned by 
sequences of the form (e(nt)/(T"a;i) : n G Z) where i G T and f G Ci{X). 

Proof. The invariance under the shift is obvious. It remains to show that every 
sequence a of the form {e{nt)f{T^xif): n € for some / G Ci{X) and t G T 
belongs to Af^iX). 

Set K = {[t, g]: g & G} and first we show that K = . We have that K is a 
subgroup of T. Since G is spanned by Go and t, we have that K is connected and 
so is either equal to T or is trivial. If K is trivial, then r belongs to the center 
Z{G) of G. Given x ^ X, its closed orbit is thus included in Z{G) ■ x, and, since it 
is equal to X by minimality, we have Z(G) ■ x = X . This means that the system 
{X, T) is a rotation on a compact abelian group, a contradiction. Thus K ^ S . 

Now let f,xo,t and a be as above. Pick g £ G such that e{t) — [g,T] and set 
xi = g • Xq and h{x) = f{g~^ ■ x) for every x G X. For every n G Z, 

h{T^x,) = h{T^g ■ xo) = h{[T, gTgr^ ■ xo) = e{nt)h{gT^ ■ xo) = e(nt)/(r" ■ xo) = a„ 

and we are done. 
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Fix xi E X. Let AI denote the closed span of sequences of the form 
(e(nt)/(T"xi): n e Z) where t e T and / e Ci{X). We need to show that for 
every xq G X and every h G Ci{X), we have that the sequence (/i(T"2;o): n G Z) 
belongs to M. 

Choose g E G such that g ■ xi = xq. Let i G T be such that e{t) = [T,g] G G2 
and define f{x) — h{g ■ x). Then for n G Z, by the same computation as above, we 
have that h{T'^xo) = e{nt)f{T^ ■ xi) and we are done. □ 

Corollary 1. Let {X,T) be an elementary nilsystem. ThenJ\f'^{X) _L AV , meaning 
that for every a G M'^{X) and every b G AV , we have Av(ab) = 0. 

//a is an elementary nilsequence and is not almost periodic, then a _L AP. 

Proof. Every function in Ci{X) obviously has zero integral with respect to the Haar 
measure of X. Thus by definition and unique ergodicity, every sequence in A/'^(X) 
has zero average. The first statement follows immediately from Part (jl]) of Lemma[T] 
The second statement follows by density. □ 

5.2. Construction of the Bohr extension. Let {X = G/T,T) be a minimal 
elementary 2-step nilsystem in reduced form X = G/T. We use following notation. 

T denotes the translation by t G G , tt : X ^ Z = G / G2T and p: G ^ Z are the 
natural projections, a = p{t) and S is the translation by cr on Z. (So tt: (X,T) — > 
(Z, S) is a factor map.) Z is endowed with its Haar measure mz- Let B(Z) denote 
the Bohr compactification of Z; it is the dual of the circle group endowed with the 
discrete topology and it contains Z as a dense subgroup. Let B(Z) be endowed with 
its Haar measure tob(z)- We write R for the (minimal) translation by 1 in B(Z). 
There exists a (well defined) continuous group homomorphism r: B(Z) —>■ Z such 
that r(l) = <T. This homomorphism is onto, and it is a factor map from (B(Z), R) 
to iZ,S). 

Define 

X = {{x, z) <E X X B(Z) : Tr{x) = r(z)} 

and let T be the restriction ofTx Rto X. We write qi: X ^ X and q2: X ^ B(Z) 
for the natural projections. 

The system {X,T) is called the Bohr extension of {X,T). 

We give a second presentation of this system. Define: 

G^{{g,z)eGxB{Z):p{g) = r{z)} ; f = {(7, 0) : 7 G T} 

and define f = (r, 1) G G x B(Z). Then G is a closed subgroup of G x B(Z), f G G 
and r is a discrete subgroup of G. The map {g,z) 1-^ {p{g),z) from G x B(Z) to 
X X B(Z) induces a homeomorphism of G/T onto X and we identify these spaces. 
Under this identification, T is the translation by f on X. 

We have that G2 = {(u, 0) : u G G2} and thus can be identified with the circle 
group S^. The action of this group on X is given by 

u ■ {x, z) = {u ■ X, z) (u G S"^ = G2, {x, z) G X) . 

This action of G2 commutes with T and the quotient of X by this action can 
be identified with B(Z) in a natural way, the identification being given by the 
projection 92- 

The next result follows classically from the fact that all eigenfunctions of X 
factorize through Z and that {Z , R) is a rotation. For completeness, we give a 
proof in a appendix [A] 
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Lemma 2. {X,T) is uniquely ergodic and the topological support of its invariant 
measure is equal to X. 

Corollary 2. {X,T) is minimal. 

5.3. Applications to elementary nilsequences. We keep the notation of the 
previous sections. As for elementary nilsystems, we define Ci{X) to be the space 
of continuous functions / on A such that 

f{u ■ x,w) ~ uf{x, w) (u G S"'", (x, w) e A) . 

Lemma 3. Let G A. The map 

(8) f^lfif^xo-.nel) 

is an isometry of Ci{X) onto the space JV^ {X) . 

Proof. Let xq = (7i(io). We identify B(Z) with T (with the discrete topology). 
Clearly, Ci(A) is the closed (under the uniform norm) linear span of the family 

of functions {x,w) i-^ (j){x)xiw) for e Ci(A) and x G B(Z). If / is a function of 
this type, then for every n £ Z, we have 

/(f "io) = HT"xo)einx) . 

Thus the sequence (/(T"xo)) belongs to 7V^(A) by part Q of Lemma[T] By density, 
the same property remains valid for every / G Ci(A) and thus formula ([5]) defines 
a map j: Ci(A) -^M^iX). 

If / G Ci(A) and a = j{f), by minimality of (A, T) we have that 

||a|U==sup|/(f«£o)| = ||/||oo 

nez 

and the map j is an isometry. 

By Part ([u]) of Lemma [U N"^{X) is the closed linear span of the family of 
sequences of the type {e{nt)h{T^xo)), where i G T and h G Ci(A). We are left with 
showing that every sequence of this type belongs to the range of j. Let x be the 
character of B(Z) corresponding to t and let f{x,w) = h{x)x{w). This function 
belongs to Ci(A), and its image under the isometry j is the given sequence. □ 

Corollary 3. Let (A, T) be an elementary nilsystem. ThenM'^{X) is irreducible, 
meaning that it does not contain any closed proper nontrivial subspace that is in- 
variant under the shift and multiplication by linear exponential sequences. 
In particular, for every non-zero a G M'^{X), we have that 5(a) = 7V^(A). 

Proof. Let a a non-identically zero elementary nilsequence belonging to 7V^(A). 
We need to show that the class 5(a) of this sequence is equal A/'^(A). 

Through the isometry defined in Lemma[3l the sequence a corresponds to a non- 
identically zero function / on A that belongs to Ci(A). Since for every t G T and 
every fc G Z the sequence e{t)(j^aL corresponds to the function x°P2 ■ T'^f, where 
X is the character of B(Z) associated to t, the space 5(a) corresponds through 
this isometry to the closed linear subspace J- of Ci(A) spanned by the functions 

X ° Q2 ■ f ° T", where x G B(Z) and n G Z. It remains to show that this space is 
equal to Ci(A). 
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Let U be the non-empty open subset {x & X : f{x) ^ 0} of X. As / G Ci{X) and 
the quotient of X under the action of is equal to B(Z), we have that U = P2^{V) 
where V is some open subset of B(Z). 

Since the closed linear span of the functions x ° P2 for x G B(Z) is equal to 
{/i : h G C(B(Z))}, we have that the closed linear span ^ of the family x°'l2- f 
for X € B(Z) is equal to 

{g €Ci{X): g = outside of U} . 

By minimality, there exists an integer m > 1 such that the sets WV, < j < m, 
cover B(Z). We chose a partition of the unity {0^ : < j < m} in C(B(Z)), 
subordinated to this cover. For any h G Ci(B(Z)), each of the functions h ■ (pj op2 
belongs to J^, and thus h belongs to J^. □ 

In this proof, the shift was only needed because the function f on X may vanish 
at some point. 

Corollary 4. Let {X = G/T, T) and {X' = G'/F', T') he two elementary nilsysteni,s 
and assume that there exists a factor map q: {X,T) (X',T') commuting with 
the action of = G2 = G'2 on these systems. Then ^P{X) = J\f^{X'). 

Proof. The factor map induces an inclusion of J\P{X) in Af^{X') and equality 
follows from the irreducibility of ^P{X'). □ 

Remark. One can check that in this case X' = X and this leads to another proof 

of the same result. 

Corollary 5. Let a be a non-zero basic elementary nilsequence. Then there exists 
an elementary nilsystem X such that 5(a) = 7V^(X). 

6. Taking products 

We know that the product of two nilsequences is a nilsequence. We consider here 
the case of two elementary nilsequences. If A and B are two families of sequences, 
we write 

A B :={ah: a e A, h e B} . 
Let (X, T) be an elementary nilsystem. Then for every G Ci {X), the function 
^•ip belongs to Co{X) and for every every xq € X, the sequence (^(T"a;o)V'(7'"a;o) : n € 
Z) is almost periodic. Thus 

J^{X)-JP{X)cAV . 

6.1. Orthogonality. 

Proposition 6. If {X = G/T,T) and {X' = G'/T',T') are two elementary nilsys- 
tems, then exactly one of the following statements holds: 

• JV^{X) =JV^{X'), and in this case M^{X) ■ Af^{X') C AV. 

• J\f^{X) ±N^{X'), and in this case there exists and elementary nilsystem 
{Y, S) such that J\P{X) ■ Af^{X') c N{Y). 

More precisely, N'^{X) = M'^{X') if and only if there exists a closed subgroup H of 
G X G' such that 
(i) {t,t')gH. 
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(ii) The commutator subgroup H2 of H is the diagonal subgroup of = G2 x 

(iii) The subgroup A = (F x F') Cl H of H is cocompact in H. 

The invariance under products of the family of elementary nilsequences follows 
immediately. Indeed, the product of an elementary nilsequence by an almost peri- 
odic sequence is a nilsequence; Proposition [6] shows that the product of two basic 
elementary nilsequences is an elementary nilsequence, and the general case follows 
by density. 

Proof. 

6.1.1. First we assume that there exists no group H satisfying properties ^ 
and (pill above. 

Let xq € X he the image if the unit element of G and x'q G X' the image of 
the unit element of G' . Then F x F' is the stabilizer of (a;o,a;Q) under the action of 
GxG' onX X X'. 

Let W be the closed orbit under T x T' oi the point {xo,Xq) in the nilsystem 
{X xX',Tx T'). It is classical that {W, T x T) is a two step nilsystem. Write W = 
H/A, where H,A satisfy properties Q and jml above. By hypothesis, property (jHI 
is not satisfied and H2 is not equal to the diagonal subgroup of . 

By minimality, the natural projection W ^ X is onto. It follows that the image 
of the natural projection H ^ G has countable index in G. Therefore this image 
is open in G and thus contains Gq. As it contains r, it is equal to G. For the same 
reason, the natural projection H G' is onto. 

Therefore H is not abelian. Its commutator subgroup is therefore not the trivial 
subgroup of T^. Let x be the restriction to H2 of the character (u, u') t-^ u ~ u' of 
T'^. Thus X is not the trivial character of H2. 

Let (y, S) be the elementary nilsystem obtained by taking the quotient of X 
by the subgroup ker(x) of G2 as in Section [4751 Let p:W~^Yhe the natural 
projection and set yo = p{xo,x'q). 

Let (j) G Ci{X) and (/>' G Ci{X'). Let $ be the restriction to Y of the function 
{x,x') ^-> This function belongs to Ci^(VF) and thus can be written as 

o p for some function G Ci{Y). For every n G Z, we have 

^iT^xo)WTT^ = HiT X TTixo^x',)) - ^{S'^yo) ■ 

Since N'^{X) is the closed linear span of the family of sequences of the form 
(<?!)(T"xo)e(nt)), and similarly for M^{X'), we have that N^{X) -M^iX') C M^{Y). 
By irreducibility we have that 

the closed linear span of N^{X)-Af^{X') is equal to J\f^{Y) . 

Since every sequence in M'^{Y) has zero average, M'^{X) _L Ar^{X'). 

6.1.2. We now assume that there exists a subgroup H oiGxG' with properties (P, 
dni) and dm]). 

Let L be the closed subgroup of G x G' spanned by A and a — {t,t'). 

Set W = L/A and let S:W ^Whe the translation by cr = (r, r'). Then {W, S) 
is a 2-step nilsystem and the natural projections W X and W ^ X' are factor 
maps. By the same argument as in Section 16.1.11 the natural projections L G 
and L G' are onto and L is not abelian. The commutator subgroup of L is thus 
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a nontrivial subgroup of H2, and by hypothesis, it is the diagonal subgroup of T^. 
Since L2 is connected, L2 = i^2• 

Substituting L for H, we are reduced to the case that 

(iv) H is the closed subgroup of G x G' spanned by A and a. 
It follows that (W, S) is an elementary nilsystem. The natural factor maps W 
X and W ^ X' commute with the actions of T = G2 = Gj = H2 on X,X' and 
W, respectively. By CorollaryH we have that Af^{X) = Af^{W) = J\f^{X'). □ 

6.2. For later use, we show: 

Lemma 4. Let X, X' be as in Proposition and let H be a closed subgroup of 
G X G' satisfying the conditions ([n]) and ([m]) of Proposition\^ Then there exist 
a subgroup Ti of T with finite index, a subgroup T[ of V with finite index and an 
isomorphism $ : Fi — > T'l such that 

(9) for every 7 S Fi, [$(7),t'] = [7,r] ; 



Proof. Let Fi and T[ be the images of A under the natural projections H ^ G and 
H ^ G', respectively. 

By (fiil|). A is cocompact in H. We have shown above that the natural projection 
H ^ G is onto. It follows that Fi is cocompact in G and thus it has finite index in 
F. By the same proof, F'^ has finite index in F'. 

For every 7 e Fi, by definition there exists 7' € r[ with (7,7') G A. Prop- 
erties (0) and imply that [7',t'] = [7,t]. Since the map 7' 1-^ [7',''''] is one 
to one, this condition completely determines 7' for a given 7. Thus there exists a 
group homomorphism $: Fi ^ F' satisfying ([9]) and (fTO|) . By exchanging the role 
played by the two coordinates, we have that <I> is a group isomorphism from Fi 
ontoF'i. □ 

6.3. Proof of Theorem [2l We start with Lemma. 

Lemma 5. For every non-almost periodic elementary nilsequence a, there exist 
a basic elementary nilsequence b with S{sl) = S{h) and an elementary nilsystem 



Proof. Let a be a non-almost periodic elementary nilsequence; in particular, a is 
not identically zero. There exists a sequence (b(j) : j > 1) of basic elementary nilse- 
quences converging uniformly to a. For every j > 1, let {Xj,Tj) be an elementary 
nilsystem such that b(j) belongs to N'^{Xj). 

As the quadratic norm is a norm (Section 14. 2p . ||a||2 > and ||a — b(j)||2 — » 
as j +00. Therefore, there exists i > 1 such that ||b(i) — b(j)||2 < ||b(i)||2 for 
every j > i. 

This implies that for j > i the sequence b(j) is not orthogonal to the sequence 
h{i). The spaces N'^{Xj) and N"^{Xi) are not orthogonal and by Proposition [51 
these spaces are equal. Therefore a(j) belongs to Af'^{Xi) for every j > i and so 
a G JV^{Xi). By Corollary[5l this space is equal to S{h{j)) □ 

We now prove Theorem [5] by collecting the results of the preceding Sections. 
([!]) Let a and b be two non-identically zero elementary nilsequences. We want 
to show that the spaces S{a) and <S(b) are equal or orthogonal. If one of these 



(10) 



A= {(7,$(7)): 7eFi} . 



{X,T) with S {a) =7V2 



{X). 
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sequences, say a, is almost periodic then 5(a) — AT and the result follows from 
Corollary [TJ 

Assume now that a and b are not almost periodic. By Lemma[S]and Corollary[31 
there exist two elementary nilsystems (X, T) and (X', T') with S{a) = N'^{X) and 
S{h) ~ M'^{X') and the result follows from Proposition [6l 

([u]) The same proof used for Lemma [5] shows that every class is open. 

([mil Follows directly from Lemma [5] and Proposition [6l 

(pv)) The unit clement for the multiplication is AV. Each class different from 
AV is equal to M{X) for some elementary nilsystem X, and by Proposition [HI the 
inverse of this class is N{X). □ 

7. Classification: reduction to the connected case 

Here we begin the proof of Theorem[3l considering first the case of an elementary 
system arising from a non-connected group. 

Proposition 7. Let {X = G/T,T) be a (minimal) elementary nilsystem. Then 
there exist t G T and an elementary nilsystem {X' = G'/T',T') with G' connected 
such thatM^iX) = q(t) -JV^iX'). 

Proof. Assume that {X = G/T,T) is an elementary nilsystem and assume that T, 
as usual, is rotation by the element t E G. Let Go denote the connected component 
of the identity in G and set Fq = F n Gq and Xq = GoF/Fo = Go/Fq. We have 
that Xq is a connected component of X and is open in X. 

First step. We first build a particular element tq G GqF such that the system 
{Xo, Tq), where To is translation by tq, is minimal. 

Since X is minimal, there exists fc 6 N such that T'^XqCiXq is nonempty. Choose 
k to the be least integer such that this intersection is nonempty. (If X is connected, 
then X — Xq and fc = 1.) By definition of Xq, K is also the smallest integer with 
t'= e GqF and T^Xq = X^. Since G is spanned by Gq and r, it follows that GqF is 
spanned by Gq and . Since (A", T) is minimal, the set 

{r"7: nGZ,7eF}nGoF = {T'=": nGZ,7eF} 

is dense in GqF. It follows that (Aq, T^) is a minimal system. 

Since G GqF and Go is connected, there exists 6 and ti e Go such that 

(11) T^=T^e. 

We now consider two cases, depending on whether Go is abelian or not. 

The abelian case. First assume that Go is abelian. Then Aq is a compact connected 
abelian group of finite dimension and so is a torus. Furthermore, Ao contains the 
one dimensional torus G2 = S^ as a closed subgroup, and so Aq can be identified 
with Zq X G2, where 

Zf) = G0F/G2F = G0/G2F0 . 
Here Zq is an open and connected subgroup of Z = G/G2F and so Zq is isomorphic 
to S'' for some d e N. Let tt: X ^ Z denote the natural projection and so 7r(T) 
denotes the image of t in Z. Let a denote the image of the element ti G GqF in 
Zq. By Equation (fTTj) . a'' = it{t)^ . Since (Ao,T*'') is minimal, the translation by 
on Zq is minimal. Therefore, there exists v € G2 such that the translation by 
(a'^, v) on Zq x G2 is minimal. Since Go is connected, there exists u G G2 such that 
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Let To be a lift of {a,u) in Go and let To be the translation by tq on Xq. Then 
{Xo,Tq) is a rotation system and {Xo,Tq) is minimal. It follows that {Xo,Tq) is 
minimal. Since Tq and r*^ both project to 7r(r)'^ on Z, there exists ry G F and 
w e G2 such that r'^ = T^'qw. Thus we have constructed an element tq of Gq such 
that: 

(i) = T^-qw for some 77 € F and w € G2', 

(ii) The system (Xo,To), where Tq is the translation by tq, is minimal; 

(ui) The system {Xo,To) is either a rotation on a compact abelian group or is 
an elementary nilsystem. 

The non abelian case. We now turn to the case that Go is not abelian. We take 
Tq = Ti, 7y = 1 and w = 1 and show that the properties (p])" (fiii|l are satisfied. 

Since Go is now assumed to be nonabelian, we have that (Go) 2 is a nontrivial 
torus. It is a subgroup of G2 = and (Go) 2 = G2. 

Again, G is spanned by Go and r. Let 7 S F and write 7 = ggT^ for some 
^0 G Go and j G Z. By definition, F is the stabilizer of some point of X and so 
j — km for some m E Z. Thus 

km r_ /)ifcm(m — l)/2/im /im 

for some G Go. Therefore 171 G Go n F = Fq and we conclude that F is spanned 
by Fo and 9. Recah that the set {t''"j: n G Z,7 G F} is dense in GoF. By 
Equation pT|). this set is included in 

{t^'^uj: n G Z,m G G2,7 G F} 

and so this set is also dense in GoF. Since Go is open, the set 

{to"u7o : n G Z, m G G2, 7 e r} n Go = {to*^"u7o : n G Z, u G G2, 7 G Fo} 

is dense in Go. Since Go is connected and (Go) 2 — Go, we have that {Xq — 
Go/To, T^) is minimal. Thus {Xq,To) is an elementary nilsystem satisfying prop- 
erties dUl-dml). 

Second step. Finally we compare the spaces J\f'^{X) and J\f'^{Xo). Let xq be the 
image in X of the unit element of G. The space Af'^{Xo) is spanned by translates 
of sequences of the form 

a= (0(r"a;o): n G Z) , 

where <j) G Ci(X) vanishes outside of Xq. By definition of Tq, we have a„ = if 
n ^ fcZ. We also use (j) to denote the restriction of (f> to Xq and define the sequence 
bby 

^r.--^Y.eijn)^{T,x,)^l otherwise . 

By construction, = T^rjw for some 77 G F and w G G2. Let u G G2 be defined 
hy 6 ■ Xq = u ■ Xq. If n = km for some m G we have that 

a„ - <l>iiT^ewr ■ xq) = (/.(To^™[ro,77]'=™(™-i)/2«;"0" • xq) 

= [ro,77]'="(™-i)/2ii,™u"0(ro*'" • :eo) = e„(5)g„(t)6„ 

for some s, i G T which do not depend on choice of (j>. 

For n ^ fcZ, we have that a„ = = e„(s)(7„(i)6„ and so a = q(i)e(s)b. Thus 
a G q(t)AA^(Xo). Since Af^iX) and q{t)AI^{Xo) are irreducible, we have that 
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N"^[X) — q{t)M^{Xo). In conclusion, we have constructed an elementary nilsystem 
such that Af^{X) = q{t)J\f^{X'). □ 

8. Classification: The connected case 

8.1. Reduction to Heisenberg systems. For Heisenberg systems we use the 
definitions and notation of Section [2.4.1l The condition for minimality of Heisenberg 
nilsystems was given in Section 14.41 

Throughout this section, we consider J\f^{X) for various spaces and various trans- 
formations on X . To minimize confusion, we write J\f'^(X,T) instead of the usual 
N^{X). 

Lemma 6. Let {X = G/T,T) he an elementary nilsystem (minimal, written in 
reduced form) where G is connected. Then there exists an Heisenberg minimal 
system {Nd,T') withN'^{X,T) =Af^{Hd,T'). 

Proof. By Lemma [12] in Appendix [B] {X, T) is the product of of an elementary 
system {X',T") of the form given by the lemma and a rotation. Since N"^{X') is 
invariant under taking products with almost periodic sequences, it is easy to check 
that A/'2(X,T) = AA2(X',r"). 

We can therefore reduce to the case that G = R^'' x S^ and T = I?'^ x {1} for 
some d>l, with multiplication given by 

(x, z) ■ {x\ z') — [x + X , zz'e{{Ax \ x')) (x, x G K^'', z, z' G S"*") 

where A \s a. 2d y. 2d matrix such that the matrix B ~ A — A*^ is nonsingular. We 
build a Heisenberg nilsystem [Nd, T') with N'^{X, T) = N"^{Nd, T'). 

Let J2d be as in Section 13.41 Choose a, 2d y. 2d matrix $ with rational entries 
such that 

$* J2d$ = B . 

(Existence of such a matrix follows using an antisymmetric version of Gauss de- 
composition of a quadratic form.) Let r = (^, 7) G R^'' x S^ = G be the element 
defining T, r' = ($((5), 1) G R^'^ xS^ = Hd and let T' be the translation by t' on 
Nd = Hd/{1d X Zrf X {1}). 

Since [X, T) is minimal, the coordinates of (5 are rationally independent modulo 1 
by Proposition[5l Since $ has rational entries, the coordinates of $((5) are rationally 
independent modulo 1 and {Nd, T') is minimal. Define 

H = { {{x, z), [x', z')) eGx Hd-. x' = z' ^ z} . 

Then H is a subgroup of G x Nd satisfying the conditions of Proposition[6]and thus 
M^{X,T)=M^{Nd,T'). □ 

8.2. The case of Heisenberg systems. 

Lemma 7. Let (Nd = Hd/ Ad,T) and {Nd' = Hd' / Ad' ,T') be two minimal Heisen- 
berg systems, where the transformations T and T' are respectively the translation 
by T = {a,P,j) G M'' X M'' X S^ ^ Hd and translation by r' = (a',/3',7') G 
R''' X R'^' X S^ = Hd'. 

Then J\f'^{Nd,T) = Af'^{Nd',T') if and only if d — d' and there exists a matrix 
Q G Sp2d(Q) mapping {a, (3) to {a', 13'). 

(We consider Q as a linear map from R'^ x R'^ to itself.) 
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Proof. First assume that M'^{Nd, T) = M'^{Nd-,T'). Let iJ, A be as in Proposition[6] 
and ri,r']^,$ as in Lemma ID Since Fi is of finite index in the group which is 
isomorphic to 'L'^ , it is itself isomorphic to Z''. In the same way, T'^ is isomorphic 
to JJ^ . Since $: Fi ^ T'^ is an isomorphism, d = d! . Moreover, <i> is given by a 
2d X 2d matrix Q with rational entries. Relation Q of Lemma [4] means exactly 
that Q belongs to Sp2rf(Q), and relation of Proposition [6] that Q maps (a,/?) to 
(a',/3'). 

Conversely, assume that d — d' and that the matrix Q G Sp2ji(Q) maps (a, /?) to 
(a',/3'). We set 

H = { {{x, y, z), (a;', y', z')) eN^xNa: (x', y') = Q{x, y), z' = z} 

where a:, y, x' , y' S and z, z' G K. Then if satisfies all the conditions of Propo- 
sition [6] and thus A/'2(A^d,T) ^JsP{Nd,,T'). □ 

8.3. Heisenberg systems and quadratic exponential sequences. 

Lemma 8. Let {Nd,T) be a minimal Heisenberg nilsystem and let t G T be such 
that for any integer m > 0, mt does not belong to the eigenvalue group of (Nd, T). 
Then the sequence q(t) does not belong to Af^{Nd,T) and there exists an elementary 
nilsystem (X, S) with q{t) ■ Af^{Nd, T) = N'^{X, S). 

Moreover, for every Heisenberg system {Nd',T'), (i{t)-J\P{Nd, T) / Af^{Nd',T'). 

Proof. Let G — Hd x Z x S^, endowed with multiplication given by 

(.9, "m, z) ■ {g', m', z') = {gg'z'"\ m + m', zz') , 

where we consider z'™ as an element of S^ = {Nd)2- Then G is a 2-step nilpotent 
Lie group, with G2 — {Hd)2 x {0} x {1}. The subgroup F = A^ x Z x {1} is a 
discrete cocompact subgroup of G. Write X ~ G/F, cr = (r, l,e(i)), and let S be 
the translation by cr on X. 

Note that G is spanned by Gq = Hd x {0} x S^ and a, and that the rotation 
induced by a on G/FG2 = T^'' x T is minimal by the hypothesis on t. Therefore 
(X, S) is minimal. It is an elementary nilsystem, written in reduced form. 

The map {g,m,z) > {g,z) from G to Hd x S induces a homeomorphism from 
X onto Nd X S^. We identify these spaces. The transformation S has the form 
(x, z) 1-^ {z ■ Tx, ze(t)). If /i is a function belonging to Ci{Nd, T), then the function 
h: {x,z) ^ f{x) belongs to Ci[X,S) and satisfies /i(S'"(a;, 0)) = qn{t)f{T''x) for 
every x & X and every n ^ 1. We deduce that M'^iX^S) is included in q(i) • 
J\f'^{Nd,T) and these spaces are equal by irreducibility (Corollary [3]). In particular, 
(\{t) ■ Af'^{Nd,T) does not contain the constant sequence 1; substituting —t for t we 
have that q(t) J\f'^{Nd,T). 

We are left with showing that when {Nd',T') is a minimal Heisenberg system, 
we have N"^{Nd' ,T') ^ q(t) ■ M'^iNd, T). Assume that these spaces are equal, that 
is, that Af^iX, S) = Af^iNd' ,T'). Let the subgroups A'^ of Ad' and Fi of F and the 
isomorphism $; A'j^ ^ Fi be given by Proposition [6] and Lemma [4l Since Fi is of 
finite index inF = AdxZx{l}, the restriction to Fi of the natural projection of 
F onto Ad can not be one to one. Therefore, there exists 7^ 7 G A'j^ such that 
$(7) — (0,m, 1) for some non-zero m G Z. By property ([9]) of Lemma [H we have 
that 

[7,t'] = [^'(7),^] = e{mt) . 



ANALYSIS OF TWO STEP NILSEQUENCES 



23 



But [7,t'] is an eigenvalue of {Nd',T') and thus of {Nd,T), a contradiction of the 
hypothesis. □ 

Lemma 9. Let {Nd, T) and {Nd' , T') he two minimal Heisenberg systems of dimen- 
sions 2d + 1 and 2d' + 1 respectively, with translations given by 

T = (ai, ...,ad,f3i,.. .,f3d,e{j)) and t' = {a[, . . .,a'^,,(3[, . . . , f3'^,,e{j')) 

respectively. Let t gT. 

Then q{t) Af^ {Nd, T) = A/"^ [Nd' , T') if and only ifd = d' and there exist a 2d x 2d 
matrix Q G Sp2£;(Q) and integers m, ki, . . . , kd, £i, . . . ,£d with m > 1 such that 

/ai+ki/m\ 



(12) 



(13) 



Q 



Old + kd/m 
Pi+£i/m 



0'i 



\Pd + id/mJ \p'J 



id mt — ^~^(fcj/3i — iiai) mod 1 . 



Proof. 

a) Let {Nd,T) be a minimal Heisenberg system of dimension 2d + 1, where T is 
the translation by r = (ai, . . . , ad, Pi, ... , (3d, e(7))- Let m,ki, . . . ,kd,£i, . . ■ ,£d be 
integers with m > 1 and assume that t £ T satisfies (|13|) . Let 

t' = (ai + ki/m, . . . ,ad + kd/m, Pi + ti/m, . . . , (3d + kd/m,e{-j')) 

where 7' G T is arbitrary and T' the translation by t' on Nd. The first 2d coordi- 
nates of r' are rationally independent modulo 1 and thus {Nd,T') is minimal. We 
compare N'^{Nd, T) and N'^{Nd, T'). 

We have that t"" = t^^uj, where u is some element of {Hd)2 = and 

7 = (fci, . . .,kd,£i, . ■ .,£d, 1) G F . 
An immediate computation gives that for every integer p, 

for some v G {Hd)2 — S^. 

Let Xf) be the image in Nd of the unit element of Hd and let / be a function 
on Nd, belonging to Ci{Nd), with f{xo) 7^ 0. Let a and b be the sequences given 
by a„ = lmz{n)f{T"xo) and 6„ = 'i-mz{'n)f{T'^Xo). These sequence are not iden- 
tically zero, the sequence a belongs to N"^{Nd,T) and the sequence b belongs to 
M'^{Nd,T') by definition. But for every integer n we have hn = f"9n(t)an by the 
above computation and thus the sequence b belongs to q{t) N"^{Nd,T). Since the 
spaces q{t)JV^{Nd,T) a.nd J\f^{Nd,T') are irreducible (Corollary [3|), they are equal: 
q{t)M^{Nd,T)^MHNd,r). 

b) Now assume that d = d' and that t G T, the matrix Q G Sp2rf(Q), and the 
integers m,ki, . . . ,kd,£i, . ■ . ,£d satisfy the conditions (fT2)) and lfT3|) . We need to 
show that q{t) ■ N'^{Hd,T) = N'^{Hd,T'). By using Lemma [71 we immediately 
reduce to the case that Q is the identity matrix. The result then follows from part 
a) above. 
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c) Assume now that q(t) -Af^iEd^T) = N'^{Hd,T'). We show that there exist 
m,ki, . . . ,kd,£i, ■ ■ ■ ,i^d and Q satisfying (fT2|) and (fTS]) . 

By Lemma [51 there exists a non-zero integer m such that mt is an eigenvalue of 
X and thus there exist integers ki, . . . ,kd,(i, ■ ■ ■ ,id such that relation ([13]) holds. 
For 1 < j < d we set a'- ofj + k-j /m and = (3j + £j /m. Let T" be the 
translation by r" = (a", . . . , a^', . . . , /3^', 7) on TV^. By Part a), {Nd,T") is 
minimal and J\f^{Nd, T") = q(t) -Af^iNd, T) = M^{Nd',T'). The conclusion follows 
from Lemma [71 □ 

8.4. Proof of Theorem [3l a) We check that if t, d, . . . , a^, /?i , . . . , are as in 

the statement of the theorem, then the sequence a = q(t)a;(ai, ijt}{ad,(3d) 

is an elementary nilsequence. 

If (i = and t = 0, this sequence is constant. If d = and t is irrational, then 
a = q(i) and this sequence belongs to A/"^ iY) for some afhne elementary nilsystem 
(Section [23]). 

Assume now that d > 0. By the discussion of Section [2.4.21 the sequence b = 
u;(q!i, • • ■ .(jj{ad, (3d) belongs to N"^{Nd, T) for some Heisenberg system Nd- Let 
t G T be an irrational and let {Y, T') be an affine elementary nilsystem with q(i) G 
N"^(Y,T'). If for every integer m ^ 0, mt does not belong to the eigenvalue group 
of Nd, then by Lemma [S] the sequence q(— t) does not belong to Af'^{Nd,T). Thus 
J\f^{Y,T') ^ A/'^(iVrf,T). By LemmalU there exists an elementary nilsystem {X, S) 
with q(t) -A/^iNd, T) = A/^^X, S). Therefore q(t)b belongs to Af^iX, S) and is an 
elementary nilsequence. 

We are left with the case that mt belongs to the group of eigenvalues of {Nd, T) 
for some integer m ^ 0. Let ki, . . . ,kd,£i, ■ ■ ■ ,id be given by (fTS]) . Q he the 
identity 2d x 2d matrix and set a'^ = aj + kj/m and f3'j = Pj +£j/m for 1 < j < d. 
Then (ai, . . . , ad, . . . , (3d) are rationally independent modulo 1 and iV^ endowed 
with the translationT' by r' = [a'^, . . . , a'^, (3'^, . . . , (3'^) is a minimal Heisenberg 
system. By Lemma[9l a = q(i)b belongs to Af'^{Nd,T') and thus is an elementary 
nilsequence. 

b) Let a be a non-identically zero elementary nilsequence. We show that its class 
contains some sequence of the announced type. 

If it is almost periodic, then its class is AV and thus contains the constant 
sequence 1. This is the exactly the sequence q(0). Now assume that a is not almost 
periodic. By Lemma [5] there exists a minimal nilsystem X with S{a) = Af'^{X). 
By Proposition [T] there exist i G T and an elementary nilsystem {X' = G'/T',T') 
with G" connected and AJ"^{X,T) = q{t) ■ N'^{X',T'). If t is rational, we have 
that q(i) ■Af'^{X',T') = Af^{X',T') and thus we can assume that t is equal to 
or is irrational. By Lemma [G] we can assume that {X' , T') is a Heisenberg system 
and AP{X,T) contains a sequence of the type uj(ai,/3i). • • ■ .u;{ad,Pd) satisfying 
the independence condition. We conclude that <S(a) contains a sequence of the 
announced form. 

c) Let t' G T be equal to or be irrationals, d,d' >0 and let ai, . . . , ad, (3i, . . . , Pd 
and a[, . . . ,a'^,, (3[, . . . , (3'^, satisfy the independence condition. Assume that the se- 
quences q{t)u}{ai,(3i). - ■ ■ .uj{ad,(3d) and q(i') '^(a'l, /^O- •■• ■'^{dd' , (3d') belong to 
the same class. Then the sequences q(t — i') a;(Q!i, •• ■ .<jj{ad,(3d) and ci;(ai, /3i). 
• • • .ijij{a'^,, belong to the same class. By the first part of Lemma[8l d and d' are 
either both zero or both non-zero. If d = d' = 0, then q(t — t') is almost periodic 
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by Proposition [6] and thus t — t' is rational. If d and d' are non-zero, then Lemnia[9] 
gives the announced relations between the parameters t, t' , d, d' , ai, . . . , /?^. 

The converse implication also follows from the same lemmata. □ 

8.5. Proof of Theorem[4l The theorem follows immediately from Theorem[3]and 
Proposition m □ 

8.6. Proof of Theorem m 

Lemma 10. Let a be a sequenee belonging to the family A4. Then the linear span 
o/{e(ii)a: u e T} is dense in S{a.) for the quadratic norm. 

Proof of Lemma[Tdi If a = e(s)q(t) for some s,i £ T, then one can easily check 
that S{bl) — AV -a. Moreover, the linear span of {e(M)a: u G T} is dense in S{a) 
for the uniform norm. Thus it is dense for the quadratic norm. 

Now consider the case that a = e(s)q(i)b where b = u;(q!i,/3i). • • ■ .u:{ad,(3d) 
with d > 1 and the independence condition satisfied. Since <S(a) = q(<)5(b), we 
can reduce to the case that s = t = 0, meaning that a = b. 

In Section [2.4.2i we built an explicit minimal Heisenberg system {N^, T), xq G Nd 
and an explicit function / G Ci{Nd) such that 6„ = /(T^xo) for every n G Z. 

Let K = {w € Nd-. fiw) = 0}. Since / G Ci{Nd), K = 7r-i(L) where tt is the 
natural projection from Nd onto Z = Hd/{Hd)2^d and L is a closed subset of Z. 
Recall that Z can be identified with T^''. 

The relation ([3]) between the function k defined in ([2]) and the theta function 
shows that f{x,y,z) defined by ^ vanishes only when one of the coordinates Xj or 
Uj of a; or y is equal to 1/2 modulo 1. Therefore, the subset L oi Z ~ T^"^ has zero 
Haar measure. It follows (as in the proof of Corollary[3]) that the linear span of the 
family of functions {/ • x o tt : x G Z} is dense in Ci{Nd) for the L'^{Nd) norm. 

For X G ^J^d for every n G Z, we have 

(/ ■ X o 7r)(r"a;o) = e{ns)f{T"xo) = e(ns)6„ , 

where s G T is the eigenvalue associated to x- Let E be the group of eigenvalues of 
T. We deduce that the closure in quadratic norm of the linear span of the family 
{e(s)b : s G E} of sequences contains all sequences of the form {h{T"xo) : n G Z) for 
h G Ci{Nd)- Therefore, the closure in quadratic norm of the family {e(s)b: s G T} 
of sequences contains all sequences of the form {e{nt)h{T'^ xq) : n G Z) for /i G 
Ci{Nd) and f G T. By Lemma [TJ it therefore contains iS(b). The announced result 
follows. □ 

Proof of Theorem [31 The result follows immediately from Proposition^ Theorem[3] 
and Lemma [TUl □ 

9. Characterization of elementary nilsequences 
In this Section we show Theorem [TJ 

9.1. The "only if" part. First we show the easy part of Theorem [TJ We restate 
it here for convenience. 

Proposition. Let a be an elementary nilsequence. There exists a compact (in the 
norm topology) subset K C £°°{1i) such that for all A: G Z, there exists i G T such 
that the sequence e{t)a''a = (^e{nt)an+k : ?! G Z) belongs to K . 
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Proof. If a is almost periodic, then the result follows immediately from the charac- 
terization (jm} of almost periodic sequences in Proposition [1] Thus we assume that 
a is not almost periodic. 

By Lemma [5l there exists an elementary nilsystem {X,T) with a G Af'^{X). Let 
{X,T) be the Bohr extension of {X,T) as defined in Section [5?2l and let xq G X. 
By Lemma |3l there exists a continuous function f on X with a„ ~ /(T^xq) for all 
n G Z. 

Recall that X can be written as G/T, where G is a locally compact 2-step 
nilpotent group, F is a closed cocompact subgroup, and T is translation by some 
f G G. The natural projection G — > X is an open map and by compactness, we 
deduce that there exists a compact subset H oi G such that G = HT. Let K be 
the subset of £°° (Z) consisting of sequences of the form 

(/(gf"-io): nGZ) 

for g £ H. Since the map (g, x) t-^ g ■ x is continuous, the function {g, x) f{g ■ x) 
is uniformly continuous on H x X and K is a. compact subset of £°°(Z). 

Let k be an integer. Pick g d H and 7 G P with = gj. The sequence 
b = (/(gr" • xo) : n G Z) belongs to K. Taking t G T with e(<) = [7, t] G G2 = S\ 
we have that for all n G Z, 

{a''a)n = a„+fe = /(rV" • xo) = /(.g7T" ' xo) = e{nt)f{gT'' ■ co) . 
Thus cr'^a = e{t)h and this completes the proof. □ 

9.2. The "if" part. In the next Subsections we show the implication (jn]) => Q 
of Theorem [TJ We restate it for convenience. 

Proposition. Let a = (a„ : n G Z) be a bounded sequence and assume that there 
exists a compact (in the norm topology) subset K o/£°°(Z) such that for all fc G Z, 
there exists t £ T such that the sequence e{t)a''a — (^e{nt)an+k : n G Z) belongs to 
K . Then a is an elementary nilsequence. 

We use the following notation. Recall that I|-||oc denotes the uniform norm on 
£°°(Z). Let B be a subset of £°°{Z). For t G T, e{t) ■ B {e(t)b: b G B). If 
G Z, cr'=B := {a^h: b G B). If z is a number, zB ^ {zh:h £ B}. 
Before the proof, we need a simple Lemma: 

Lemma 11. Let E be a syndetic subset of "L of syndetic constant L, meaning that 

L-l 

[jU + E)^Z. 

0=0 

Lft£T is such that 

\e{nt) — 1| < 1/3L for every n G E and all \t\ < 1/3L , 

then t = 0. 

Proof of the lemma. If \e{nt) — 1| < 1/3L for all n £ E, then for every n G Z there 
exists j with < j < L such that n G E + j. Thus the point nt belongs to the 
interval {jt - l/3LJt + 1/3L). 

Therefore, Zt is included in the union U of the intervals {jt — l/3L,jt+l/3L) for 
< j < L. The complement of C/ in T contains a closed interval J of length l/3i. 
As the sequence {nt: n G Z) avoids J, \t\ > 1/3L and we have a contradiction. □ 
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9.3. First reductions. We now turn to the proof of the Proposition. We can 
obviously assume that the sequence a is not almost periodic and in particular not 
identically zero. We can also assume that 

l|a||oo = 1 • 

Assume that a belongs to K. Substituting the compact set 

S^-i^ :={wb:weS\ b e X} 

for if, we can assume that K is invariant under multiplication by constants of 
modulus 1. Write 

= {ue{t) ■ CT"a: m e S\ i £ T, n e 1] 

and let VI denote the norm closure of Vl in f°°(Z). We remark that Vl is invariant 
under the shift tr, under multiplication by constants of modulus 1 and under the 
operators of multiplication by exponential sequences. By hypothesis, we have 

C y e{t) ■ K . 

Substituting K f^Q, ior K we can assume that 

K cCl . 

9.4. First step. We obviously have that 

||b||oo = 1 for every b G f2 . 
Claim 1. r2 is closed under pointwise convergence. 

Proof. Let (b-,- : j G N) be a sequence in f2, converging pointwise to a sequence b. 
For every j G N, we write 

hj — e(tj)cj where tj e T and Cj G K for every j . 

By passing to a subsequence, we can assume that the sequence {tj : j G N) converges 
to some t in T and that the sequence (c^- : j G N) converges uniformly to some c G K. 
Thus b = e(t)c. Since is invariant under multiplication by e(t) and contains K , 
we have that b G f2. □ 

Claim 2. The set S = {n E Z: |a„| > 2/3} is syndetic. 

Proof. Assume that S is not syndetic. Then there exists a sequence {kj : j G N) of 
integers such that (cr'^Ja) converges pointwise to a sequence b with ||b||oo < 2/3. 
By Claim [U b G fi, and thus ||b||tx3 = 1, a contradiction. □ 

In the sequel, we write L for the syndetic constant of the set S. 
From the last claim we immediately deduce: 

Claim 3. For every b G f2, the set {n G Z: |&„| > 1/2} is syndetic of syndetic 
constant L. 

Claim 4. For every compact subset Q of Cl, the family of sets {e{t) • Q: < G T} is 
locally finite. More precisely, every ball B of radius r < 1/25 L intersects e{t) ■ Q 
for only finitely many values of t. 
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Proof. Let i? be a ball of radius r < 1/25 L and let {tj : j G N) be a sequence of 
distinct elements of T such that B D e{tj) • Q ^ for every j G N. 

For every j, we chose Cj e Q with e{tj)cj G B. Passing to a subsequence, we 
can assume that the sequence {tj : j G N) converges to some t in T and that the 
sequence {cj : j e N) converges uniformly to some sequence c G Q. We note that 

c gCi. 

For all i,j G N, by the triangle inequality, 

\\e{tj-U)c\\ao < \\e{tj)c-e{tj)cj\\oo + \\e{tj)cj-e{ti)ci\\oo + \\e{U)c-e{U)ci\\oo 

< \\c - Cjlloo + ||c - Cilloo + 2r 

because e(ti)ci and e{tj)cj belong to B. 

Let i and j be sufficiently large. The last quantity is < Ar and thus 

|e((ij -ii)") - 1| < 8r < 1/3L 

for n in the set F = {n G Z: |c„| > 1/2}. As we also have that \ti — tj\ < 1/3L, 
Claim [3] and Lemma [TT] give that ti — tj, a contradiction. □ 

We immediately deduce: 

Claim 5. For every compact subset Q of f2, the union of the sets e(<) • Q for t G T 
is closed. 

Claim 6. 

O = (J e(t) • K . 

teT 

Proof. The union on the right hand side is closed by Claim O it contains Q and is 
included in ft by construction. □ 

Claim 7. Q is locally compact. 

Proof. Every closed ball of radius r < 1/25L is covered by sets of the form e{t)K 
by Claim[6]and intersects only finitely many of them by Claim[4l It is thus included 
in a finite union of sets of this form and so is compact. □ 

9.5. A group of transformations. Let Isom(f2) denote the group of isometrics 
of n, endowed with the topology of pointwise convergence. This topology coincides 
with the compact-open topology, as well as with the topology of pointwise con- 
vergence on the dense subset f2 of fj. We write the action of this group on as 
((?, b) 1^ g • b for g G Isom(r2) and b G O. Let G be the closure in Isom(r2) of the 
group spanned by the shift and the operators of multiplication by e(<) for t E T. 
This operator is written simply e(t). 

Wc remark that for i G T, the commutator of a and e{t) is multiplication by the 
constant e(— <). Therefore, the commutator subgroup of G is the group of multipli- 
cation by constants of modulus 1, identified with S , and G is 2-step nilpotent. 

Claim 8. Let {ui: i G /) be a generalized sequence (a filter) in S^, (i^: z G /) a 
generalized sequence in T, and (fc^ : i G /) a generalized sequence in Z. For every 
i G /, let gi — Uie{ti)a^^ G G. Then the generalized sequence [gi : i E I) converges 
in G if and only if 

(i) The generalized sequence (gi ■ a: i £ I) converges in Cl; 

(ii) The generalized sequence (m^ : i G /) converges in S^; 
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(iii) The generalized sequence {ki: i e /) converges in the Bohr group B(Z), 
meaning that for every t E D the generahzed sequence (kit: i G I) con- 
verges in T. 

Proof. Let b — ue{t)a^a G £7, with u G 5^, t G T, fc G Z. For every i G I we have 

gi ■ h = eikti — kit) ue{t)(T^ gi ■ a. . 

The three conditions of the claim are equivalent to the property that gi ■ b converges 
for every b G fi. □ 

Claim 9. G acts transitively on f2. 

Proof. Let b G fi. Since is dense in fi, there exist sequences {si: i I), {ti: i E I) 
and (fci : i G /) as in Claim [8] such that that e{si)e{ti)a^^ • a ^ b. Substituting 
subsequences for these sequences we can assume that properties (jn]) and fml) are 
satisfied. The limit g of the sequence {e{si)e{ti)a''') satisfies g ■ a — h. □ 

Claim 10. For every compact subset L of fl, the subset L = {g E G: g ■ a E L} oi 
G is compact. Moreover, G is locally compact. 

Proof. Let h G fl. Choose h G G such that h ■ a = h. For every g € L, we have 
g h = ghg~^h~^hg ■ a. Thus L • b is included in the compact set h ■ L and so is 
relatively compact. The first part of the Claim follows from Ascoli's Theorem, and 
the second part from the fact that fj is locally compact (Claim [7|). □ 

9.6. The space X. Let F be the subgroup {e{t) : t G T} oi G. It follows immedi- 
ately from Claim m that F is discrete and closed in G. 

Write X = G/T endowed with the quotient topology. For h G G, the map 
g ^ hg from G to G induces a homeomorphism of X that we write x <—>■ h ■ x. We 
remark that the map G x X X defined by {h, x) !—>■ h ■ x is continuous. 

By Claim [TUl K = {g G G: g ■ a G K} is a compact subset of G and by 
Claim [6] we have that G is the union TK of the sets e{t) ■ K for t G T. Since K is 
invariant under multiplication by constants of modulus one, K is invariant under 
multiplication by S^ and TK = KT. Therefore the restriction to K of the natural 
projection G X — G/T is onto and we have: 

Claim 11. X IS compact. 

Let the function / on G be defined by 

/(g) = (g-i.a)g , 

where the subscript denotes the coordinate corresponding to 0. This function is 
continuous and for every t G T, 

f{ge{t)) - (e(-t)g-i • a)„ - {g-' • a)„ - f{g) . 

(Recall that e(— <)b is the product of the sequence b and the sequence e{t) = 
{e{nt): n G Z). Therefore we have (e(— t)b)o = 6o-) Thus the function / induces 
a continuous function f ox\ X . We remark that for every x G X and every u G S , 
we have f{u ■ x) — uf{x). Using terminology similar to that in Definition [3] and 
Section [5T3I we say that the function / belongs to Ci{X). 

Let T : X ^ X he the map x ^ tr"^ • x and let xq be the image in X of the unit 
element of G. For every n G Z, we have 

/(r".To) = /(a-") = (a" ■ a)o = a„ . 
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9.7. Conclusion. This situation was studied in [HM] in the case that G is metriz- 
able, but the same proof extends to the present case. We outline the method. 

It is classical [13 that the locally compact 2-step nilpotent group G is an inverse 
limit of 2-step nilpotent Lie groups. This means that there exists a decreasing 
family (Ki) of compacts subgroups of the center of G, with trivial intersection, 
such that G/Ki is a 2-step nilpotent Lie group for every i. Therefore the system 
{X,T) is the inverse limit of the 2-step nilsystems [Xi = G / KiT ,Ti) where T; is 
the transformation of Xi induced by T. For every the commutator subgroup of 
G/Ki is the circle group, and thus {Xi,Ti) is an elementary nilsystem. For every 
I, let Pi'. X ^ Xi he the natural projection and set Xi — pi{xo). The function / 
on X is the uniform limit of functions of the form fi opj, where fi G Ci{Xi) for 
every i. This gives us that the sequence a is the uniform limit of the sequences 
a(z) := {fi{T"xi) : n € Z), and so is an elementary nilsequence. □ 



Appendix A. Proof of Lemma [2] 

We recall the notation introduced in Section [521 We have that {X = G/T,T) 
is an elementary nilsystem, where T is the translation by r G G and fj, is its Haar 
measure. The Kronecker factor of this system is {Z,mz,S) and tt: X Z is 
the factor map. As before, p: G — > Z is the natural homomorphism, so that S 
is the translation by cr = p(r) on Z. Finally, B(Z) is the Bohr compactification 
of Z, endowed with the translation i? by 1 and with its Haar measure m, and 
r: B(Z) — > Z is the continuous homomorphism characterized by r(l) = a. 

The system {X,T) denotes the Bohr extension of {X,T): X — {{x,z) e X x 
B(Z): Tr{x) — r{z)} endowed with the translation T — T x R; qi: X ^ X and 
^2 : AT — > B(Z) are the natural factor maps. 

We first show that the system (A,T) is uniquely ergodic and that the invariant 
measure is the conditional independent joining (we recall the definition below). 



A.l. Notation. Let be a T-invariant measure on X. 

By unique ergodicity of (B(Z),i?) and (A, T), the images of ly under qi and 
q2 are equal to m and /i, respectively (In other words, is a joining). We write 
E^: L^{m) L'^{mz) and : L^(/i) L'^{mz) for the operators of conditional 
expectation, defined as usual by: 

for every (j) e L^{m), ip £ L^ifJ^) and h e L'^{mz), 

E,.0 • h dmz — / (p ■ h o r dm and / E^ V • dmz ~ / ip ■ h o p djj, . 



We claim that v is the conditional independent joining /i Xz m oi fj, and m over Z, 
meaning it is the measure on A x B(Z) defined by: 

for every (j) £ L^ifJ-) and ip G L'^{m), 

ip{x)ip{w)dii X z m,{x,w) — / Ep0(z) ■ Er'ip{z) dmz{z) . 
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A. 2. Proof of the Claim. The measure v defines a continuous operator $ : L?(rn) - 
L\ii) by: 

for every (p G L^{l^) and every ip £ L'^{ni), 

(f){x)il}{w) duix^w) — I ^i(j{x) (j){x) diJ.{x) . 



Since v is invariant under T = Tx _R, we have that $oi? = To$. If?/; is a character 
of B(Z), it is an eigenfunction of (B(Z), R). Thus is an eigenfunction of X and 
by hypothesis factorizes through Z. Since the characters of B(Z) span L^{m), 
the same property holds for every ip G L^{m). 
Therefore the last integral is equal to 

'^ili{x)¥^p(l) o p[x) dn{x) = j %lj{w)¥.p(f) o p{x) dv{x,w) . 

since v is concentrated on X, it follows that p{x) = r{w) for z^-almost every {x,w) 
and the last integral can be rewritten as 

'ip{'w)Ep(l) o r{w) di^{x,w) = J ^j{'w)¥.p(f) o r{'w) dm[w) . 

The projection of on Z is equal to m and using the definition of the operator Ep, 
this is equal to 



'¥.p<f>{z)W.rip{z) dmz{z) — j (l){x) ^p{w) d^i X z 'm{x,w) . 
By definition of this measure, and our claim is proved. 

A. 3. In particular, {X , T) is uniquely ergodic with invariant measure iJ,x zm. The 
topological support of this measure is clearly equal to X. □ 

Appendix B. Elementary nilsystems arising from connected groups 

We explain how elementary nilsystems with a connected group have a simple 
form. Similar results appear in [lOj . Simply connected, connected nilpotent Lie 
groups admitting a discrete cocompact subgroup have been well understood since 
Malcev [12] and we refer to Chapter 5 of [4] for their properties. The proof reduces 
to this case and we only give a sketch of the reduction. 

Lemma 12. Let {X ~ G/T,T) be an elementary nilsystem (minimal, written in 
reduced form) with connected group G. Then {X,T) is the product of a rotation 
on a finite dimensional torus with an elementary nilsystem (X' — G' /T',T') of the 
following type: 

d > 1 is an integer, A is a 2d x 2d matrix with integer entries such that the 
matrix B = A — A* is nonsingular; G — R^'' x S^ with multiplication given by 

{x, z) ■ {x', z') ^ {x + x' , zz'e{{Ax \ x'))) 

and r = Z"^ X {!}. 

Proof. Let G be the simply connected covering of G, p: G — ^ G be the natural 
projection and let F = p^^{T). Then G is a simply connected, connected 2-step 
nilpotent Lie group, the kernel of p is a discrete subgroup of the center of G, and 
F is a discrete cocompact subgroup of G. Since G2 is the circle group, G2 is of 
dimension 1. 
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Let Wi , . . . , Wm , Z he a Malcev base of the second kind of the Lie algebra of G. 
This means that every g ^ G can be written in a unique way as 

g = exp(t(JiWi) . . . exp(wmWm) eicp{zZ) with wi, . . . , Wm, z G M , 

that G2 = {exp(zZ) : s G M}, and that 

f = {exp(piXi) . . . exp(p™X™) exp((2'W^) : _pi, . . . ,_Pm, g G Z} . 

We use the coordinates of G associated to this base and identify G with R"* x K, 
G2 with {0} X R and F with Z™ x Z. Then the multiphcation in G is given by 

(wi, . . . , ■ {w[, . . . , u;J„,z') = (wi + . . . , W„i + w'^, z + z' + (Aw I w')) 

where w — {wi , . . . , Wm), w' = {w[ , . . . , w^) and A is an m x m matrix with integer 
entries. The commutator map is given by 

[{wi,...,Wm,z) ■ {w[,...,w'^,z')] = (0, ...,0, {Bw I w')) , 

where i? = A* - A. 

We can write m = 2d+q and find abase of Z^'^xZ* of the form {ei, . . . ,e2d, fi, ■ ■ ■ , fq) 
such that ifi, ■ ■ ■ , fq) is a base of the kernel of the matrix B. The center of G is 
thus the linear span of the vectors fi, . . . , fq and exp(Z) = (0, . . . , 0, 1). 

By hypothesis, the intersection of the center of G and F is trivial. It follows that 
fi, . . . , fq and exp(Z) belong to the kernel of the projection p. 

Let A be the subgroup spanned by these elements, G" — G/A and let F' be the 
image of F in G'. Then X = G' /T' and G',F' have the announced form. □ 

Appendix C. Non-examples of nilsequences 

C.l. A non-almost periodic example. First we show that the sequence b de- 
fined by hn — e{\na\[3: n>\), where a,/3 are independent over the rationals, is 
not almost periodic. 

Let {kj : j > 1) be a sequence of integers such that the sequence [kja: j > 1) 
converges to modulo 1 and {[kja\f3: j > 1) converges to some 7 modulo 1. 

If b is almost periodic, then by passing to a subsequence, which we also denote 
by [kj : j > 1), we can assume that the sequence (a'^^h: j > 1) converges uniformly 
to some sequence c. On the other hand, it is easy to check that {a^^h: j > 1) 
converges to e{'j)h in quadratic norm, but not uniformly. 

We have that c = e(7)b, a contradiction. 

C.2. A 2-step nonexample. We show that the sequence e([n/3Jna), where a,f3 
are independent over the rationals, is not a 2-step nilsequence. 

We proceed by contradiction. Assume that this sequence is a 2-step nilsequence. 
Then using Proposition [2l the sequence a given by 

On = e{lnp]na ap) 

also is a 2-step nilsequence. 

Consider the Heisenberg nilmanifold A^i = G/F, endowed with translation by 
T = {a, (3,0). Let e denote the image in A^i of the unit element of G. The sub- 
set = [0, 1) x [0, 1) x T of i/i = M X M X T is a fundamental domain for the 
projection p: Hi — > A^i. Thus there exists a unique function h on A'^i such that 
h{p{x,y, z) = e{—z) for every (x,y,z) G F. Note that h is Riemann integrable, 
but is not continuous, and that for every n we have a„ = h{T"e). (In fact a 
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general statement along these lines holds. Let {X, T) be a minimal fc-stcp nilsys- 
tem, xo £ X, and / be a Riemann integrable function on X. If the sequence 
{/(T^xq) : n > 1) is a fc-step nilsequence, then / is continuous.) 

Let {hj : j > 1) be a sequence of continuous functions on A'^i converging to h 
in L^(A^i) and for every j, let a(j) denote the sequence {hj{T'^e): n £ Z). By 
Proposition [3] and Lemma (TJ each of these sequences is an elementary nilsequence 
belonging to M'^{Ni). As j — > +oo, a(j) converges to a in quadratic norm (see 
Section EH). 

By Proposition 2] and Theorem [21 proceeding as in the proof of Lemma [SJ it is 
easy to deduce that if a nilsequence is a limit in the quadratic norm of elementary 
nilsequences belonging to A/'^(X), then it also belongs to N"^{X). In particular, it 
is an elementary nilsequence. Therefore a is an elementary nilsequence. 

Let {kj : J > 1) be a sequence of integers such that kja and kj(3 tend to modulo 
1 and tilti — llaP converges modulo 1 to some 7. 

By Theorem [1] passing to a subsequence of {kj : j > 1) if necessary, we can 
assume that there exists a sequence {tj : j > 1) in T such that the sequence 
(e{tj)a^^ sl: j > 1) converges uniformly as j — > 00 to some sequence. 

On the other hand, it is easy to check that that the sequence {e{kja(3)a''a.: j > 1) 
converges as j ^ c» in quadratic norm, but not uniformly. We deduce that the 
sequence (tj — kja^: j > 1) is eventually constant, and a contradiction follows. 
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